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An analysis of pilot behavior, both from an airline training simula- 
tor and an actual DC-10, is presented for the landing maneuver. An 
emphasis Is placed on developing a mathematical model In order to Identify 
useful metrics, quantify piloting technique, and define simulator fidel- 
ity. On the basis of DC-10 flight -seasurements recorded for 32 pilots — 

13 flight-trained and the remainder s Imul a tor-t rained a revised model 

of the landing flare Is hypothesized which accounts for reduction of sink 
rate and preference for touchdown point along the runway. The flare ma- 
neuver and touchdown point adjustment can be described by a pitch attitude 
command pilot guidance law consisting of altitude and vertical velocity 
feedbacks. The pilot gains wnich are Identified directly from the flight 
and simulator data show that the flare Is being executed differently In 
each medium. In flight most of the subject pilots exhibit a significant 
vertical velocity feedback which Is essential for well controlled sink 
rate rcJuctlon at the desired level of response (bandwidth). In the simu- 
lator, however, the vertical velocity feedback appears Ineffectual and 
leads to substantially Inferior landing performance. The absence of the 
vertical velocity feedback Implies a simulator fidelity problem, and sev- 
eral specific posaibllities are discussed. The pilot model of the 
mir.cuver provides Inslpi'f Into which aircraft types could be simulated 
without Incurring the apparent fidelity limitation encountered In this 
case. 


INTKODOCTlON 


This paper Is a siramary of portl'^n*. of an analysis of airline landing 
data which was performed for NASA v .■ Research Center under Contract 
NAS2-10817 and reported In Ref. 1. The purpose of the study was to focus 
on the landing maneuver as It 1 $ p^ • ferme-d both In flight and In an air- 
line training simulator in ordci to: (a) measure absolute differences 

between pilot-vehicle behavior, (b) -levelop landing maneuver performance 
metrics, and (c) define how to use such meLrlcs in both simulator and 
flight. 

The data base used in this analysis wa:> collected during a NASA field 
evaluation of the sole use of simulator training In transitioning airline 
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pilots to a new aircraft type (Ref. 2). The unique aspect of the data 
acquired Is that they Involve both actual flight and simulator measure- 
ments for a reasonably large nuaber of pilots. Further !iore specific 
attention was devoted to making the flight and simulator data directly 
comparable In terms of pilots, aircraft, and environmental conditions. 

The procedure used In analyzing the available data was based on man- 
ual control theory (Ref. 3 which treats hman psychomotor and cognitive 
behavior as rational, well-tailo ed actions dependent upon the task > ve- 
hicle dynamics, and envlronme^.t . These actions can be essentially closed 
loop and compensatory in nature or progressively more open loop and pre- 
cognltlve depending upon the pilot's level of skill or workload demands. 

The ISiiue of simulator fidelity has been stated in terms of manual 
control theory In Ref. 4 and is highly rcalevant to the analysis. In fact 
perceptual fidelity is addressed In terms of **essentlal cueing" as dis- 
cussed In Ref. 5. As will be seen, there is evidence that the training 
simulator involved In this study was somehow deficient in inducing the 
pilot behavior observed In flight. This kind of deficiency should be duly 
noted In the design and actual use of any simulator where flight task and 
aircraft conditions are similar to those studied here. 


STMOr^S 


h 




rD 

max 


k 

k 

k 


h 

fi 

Y 


s 




U) 


FL 

^8 


Height 

Touc hd own sink rate 

Maximum sink rate 

Pilot height loop gain 

Pilot vertical velocity loop gain 

Pilot flight path angle loop gain - Uk^ 

Laplace operator 

Effective aircraft flight path lag 
Airspeed 

Effective damping ratio of the landing maneuver 
Pitch attitude cemraand 

Effective natural frequency of the landing maneuver 
Pitch loop crossover frequency 


PLAU NODKL 


Ihe appendix of Ref. I reviewed some existing models of the flare 
maneuver (Refs. 6 thr<>ugh 9), considering their ulrong and weak points. 
These ideas were taken into account in constructing a revised flare model 
which would better explain the recently-acquired landing data as well as 
encompassing past measurements. One important aspect of this revised 
model is that there Is no added complexity over previous models discussed, 
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In fact there is significant reduction in conqplexity so much so that a 

closed analytic form can be expressed for time histories of altitude, sink 
rate, normal acceleration, airspeed decay, and touchdown point along the 
runway. Furthermore it is possible to describe a clear role for the im- 
portant aircraft properties as well as for the pilot control law 
properties. Hiis ultimately aids in developing metrics for analyzing the 
landing maneuver. 


Height 
hi CFT) 



Figure 1. Phase Plane Trajectory of a Typical Landing Maneuver 

The theoretical basis for the revised model is the assumption of 
dominant second-order characteristic response which is strongly suggested 
by the phase planes constructed from flight data of which Fig. 1 is an 
example. This leads to the basic characteristic equation: 

h + h + h * 0 

FL FL FL 


It is further assumed that this characteristic equation is associated with 
a pilot-vehicle system having an altitude command loop (outer loop) and 
that the flare maneuver corresponds to the response from an initial offset 
with respect to the terminal conditions (l.e., from an initial altitude 
and sink rate). Thus, analytically, the flare is regarded as an unforced 
response from a set of initial conditions to a set of desired conditions 
at touchdown. 
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In considering the pilot control law implications of a second-order 
characteristic response, the first step is to examine the aircraft equa- 
tions of motion with respect to altitude. The complete longitudinal 
formulation described in Ref* 10 can be simplified to a first-order, 
single-axis form: 


h + 
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Where is the effective first-order lag time constant between a pitch- 
command, 0^, and flight path response. 

The approach used to infer piloting technique In the landing maneuver 
was to solve directly for the difference between a fitted differential 
equation describing closed-loop motion and the effective flight path re- 
sponse of the basic airplane. The difference, assuming negligible 
atmospheric disturbances, should be the effect of pilot actions and can be 
Interpreted literally as a pilot control law, i.e., 
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Rearranging the result. 
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Hence the effective control law gains can be related directly to param- 
eters describing the maneuver and the aircraft: 
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or bes/.rtf a control law term on flight path angle. Y» rather chan sink 
rate, h: 
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IDEMTIFICATION OF PARAMETERS 


The foregoing theoretical development shows that two motion param- 
eters and one aircraft parameter are needed to obtain the effective pilot 
control law parameters. 

The aircraft parameter, T^^, was obtained from an estimate of the 
flight path response for a pitch attitude command in a DC-10 at an average 
landing weight and speed. Allowance was made for the contribution of lag 
in the closed-loop pitch response as well as the lag due to airframe heave 
damping, T 0 . effective first-order pitch response lag of 0.7 sec was 
assumed based on previously observed transport aircraft pitch attitude 
closures ranging from 1 to 2 rad/sec crossover frequency, . For the 
airframe heave damping component, a value of 1.8 sec was estimated for the 
average T 0 corresponding to the loading and approach airspeeds flown. A 
composite flight path response lag, T^q, was obtained by summing the pitch 
response and heave response lags, i.e.. 



This approximation can be shown to be valid for landing maneuvers having 

an effective damping ratio, in the vicinity of 0.7 the nominal 

value found in the flight data. 

The landing maneuver was identified directly from phase plane trajec- 
tories plotted for the flight and simulator landings. Two separate 
procedures were developed for obtaining independently the effective flare 
damping ratio , and the effective natural frequency , Wpj^. It was 

found that a strong relationship existed between CpL the ratio of 

touchdown sink rate to maximum sink rate (just prior to flare), ^xi)/^^niax* 

The effective natural frequency of the flare, shown to be a 

strong function of the shape of the flare trajectory and nearly indepen- 
dent of CpL* As a consequence it was possible to identify u)pj^ using 
transparent overlays of families of phase plane trajectories. 


RESULTS OBTAINED 
Nominal Landing Maneuver 


The check-ride landings of the flight-trained group of pilots were 
used to obtain an indication of the nominal landing maneuver for the 
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DC-10. Figure 2 shows samples of the flight data in terms of landing 
trajectory phase planes for several pilots. Note that for each of the 
five pilots there were three landings. Figure 3 shows the identified 
landing maneuver parameters, ^FL» these pilots along with a 

plot of pilot control law parameters. (Note that the height loop gain, 
is plotted opposite Wp^and the effective flight path angle gain, k^, 
ds plotted opposite CpL^PL*) Means and standard deviations of nominal 
landing parameters are summarized in Table 1. 

It can be seen that the nominal flare maneuver parameters are grouped 
in rational locations with respect to the several factors, previously 

mentioned, which affect the landing; namely, the natural frequency an 

indicator of closed-loop bandwidth is situated midway between the 

closed-loop airspeed response mode (about 0.1 rad/sec for this aircraft) 
and the closed-loop pitch response (about 1 to 2 rad/sec). This parti- 
tioning of frequency helps to insure that airspeed will not bleea off 
excessively during the landing maneuver, and that pitch response will not 
significantly detract from the heave response phase margin. (If pitch 

loop crossover is set too close to flight path crossover, then a K/s^-llke 
controlled element is created.) The nominal value of damping ratio cen- 
tered at about 0.7 helps to Insure that a good touchdown sink rate is 
obtained regardless of the conditions at flare initiation. Too low a 
damping ratio, say 0.4, would correspond to a hard landing even from a 
nominal approach sink rate. At the other extreme, a damping ratio greater 
than, say, 0.9 would correspond to a floating tendency resulting in exces- 
sive runway landing distance. The nominal - 0.7 and rad/sec 

are therefore entirely appropriate from the standpoint of good closed-loop 
control considerations. 

The nominal piloting technique parameters spanned a range of effec- 
tive loop gains. Most noteworthy, however, is that some degree of sink- 
rate or flight-path-angle feedback is apparent except wher(| a very low 
height gain is employed. For the average k|^ of 0.13 deg/ft , an average 
k^ of 0.45 (or k^ of 0.12 deg/ft/sec) was observed. This in turn implies 
that cues in addition to height may be used by the pilot. These data, 
however, did not indicate which of the several visual (or even motion) 
cues might have been involved. 

In addition to the two landing maneuver parameters, 
attention was given to how to characterize initiation of the landing. 
Flare height has been generally regarded as a likely candidate for a land- 
ing parameter, but the data showed no clear tendencies. Instead a wide 
range of heights for flare initiation were observed. Also most landings 
involved a “duck-under,” i.e., an Increase in sink rate, just prior to the 


* This agrees with the DC-10 flight manual procedure — about 3.5 deg net 
pitch change over the final 30 to 40 ft. 
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cio..d-Loop R«poM. Hrt^tert b. WXot Control^Uw P.r«et«r. 



Figure 3. Closed-Loop Flare Parameters Representative of 
Skilled Pilots In Flight 


TABLE 1. AVERAGE PILOT BEHAVIOR IN FLIGHT PILOTING TECHNIQUE 


Fe«turtg Flight-Trained 

Of >fincuvcr Paraaetcra Pilots Exhlbltlgg Reaarka 

and Pilot Behavior Good Landings 


Oontrol of 

^FL 

0.68 t 0.09^ 

Effective 

touchdown 


reduction in 

sink rate 

^D^^aax 

0.25 t C.U 

■Ink rate 




Bandwidth high enough to 


(rad/sec) 

0.42 t 0.09 

precede eirapeed decay 

Abruptness of 


(about 0.1 rad/aec) and 

flare maneuver 

tri* (rad/sec) 

0.28 ± 0.06 

low enough to aecomaodat 
lag In pitch attltuda 


*^h 


romnwind (about 1 rad/sec) 


(radVsec^) 

0.19 * 0.08 

Cbnslacenc with flight 

Height 


manual about 1.5 deg 

Feedback 

k|^ (deg/ft) 

0.13 t 0.05 

attitude change over the 
final 30 to 40 ft 

W rect lon- 

^fl"fl (***<*^*«c) 

0.29 t 0.08 

dlgnlficent feedbeck of 

of-f 1 ight 


dlrectlon-of ‘flight or 

feedback 

k^ (deg/deg) 

0.45 t 0.35 

iCe equivalent 


* < 3 fc/sec, no floating (Croup FA), 

f %an ♦ standard deviation. 
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final reduction In sink rate. In fact the duck-under maneuver fitted the 
phase plane trajectory of the flare itself, l.e., the same pilot control 
law generated both maneuver segments as shown in Fig. 4. Furthermore the 
initiation of the duck-under ranged even greater in height than did the 
flare, per se. , /ct^ 



Model trajectory according 
to Identified paraneter^ 

. 0 . 60 , uy, ■- 0 J7) 


Figure 4. Typical Landing Maneuver Performed in the Actual Aircraft 


A NASA research pilot observed that the combined duck-under and flare 
was a natural action aimed at adjusting touchdown point along the run- 
way . A normal electronic glide slope may Intercept the runway at a con- 
servative distance from the runway threshold. Thus at some judicious 
point prior to flare the pilot may elect to transition from the electronic 
glide slope to a lower approach slope. The data suggest that this final 
adjustment is integrated with the flare and that the height of that ad- 
justment corresponds to how large a change is desired in the nominal 
touchdown point. Hence "flare height" or "landing initiation height" 
should not be regarded as a constant. Rather it is a "control" used to 
alter the point of touchdown along the runway. 
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Landings in the Slaulator 


Substantially different average landing behavior was observed In the 
simulator. The same analysis procedure was applied, i.e. , identification 
of landing maneuver parameters from phase plane trajectories. A summary 
of results is given in Table 2. 


TABLE 2. AVERAGE PILOT BEHAVIOR IN FLIGHT AND IN THE SIMULATOR 

SIMULATOR FIDELITY 


Features All Flight- All All Pilots 

of Maneuver PsrsMtcrs Trained Pilots Pilots In the Reaarks 

and Pilot Behavior In Flight in Flight Slaulator 


Control of 

**FL 

0.68 

0.67 

0.58 

Harder landings 

touchdown 





In the 

sink rate 


0.2 5 

0.27 

0.^2 

s loulstor 

Abruptness 

<rad/sec) 

O.AO 

0.37 

0.36 


of flare 





No difference 

naneuver 

w (rad/sec) 

0.27 

0.25 

0.27 



(rad^/sec^) 

0.17 

0.13 

0.15 


Feedback 





No d 1 f f ♦* rence • 


(deg/ft) 

O.ll 

0.06 

0.10 








Dl rect lon-of - 

'FL“a <«</••«) 

0.26 

0.25 

0.20 

Dlrectlon-of-f 1 tght 

flight or sink 





loop lacking In the 

rate feedback 

(dtt/deg) 

0.40 

0.25 

£ 

s loulstor 


The most obvious difference between simulator and flight was in the 
firmness of landings. This is reflected in the ratio of sink rate decay, 
^TD^^max’ effective damping ratio, CpL* At the same time the 
abruptness of the flare maneuver and corresponding height feedback were 
comparable between simulator and flight. 

One Important piloting technique implication from the above observa- 
tions is that the effective directlon-of-f light or sink rate feedback is 
Inadequate in simulator landings. A further implication la that a cue 
deficiency exists. The exact nature of that cue was, however, not clear 
from the data although visual perception of sink rate is suspected. 

An additional feature of the simulator data was that there was an 
absence of the initial duck-under maneuver which was so prominent in the 
flight data. This could be Interpreted as either the absence of a runway 
distance cue or a different approach geometry which made a duck-under 
unnecessary . 
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As suggested in Ref. 4 the fidelity of the simulator can be judged on 
the net difference in piloting technique exhibited in the simulator c.ji- 
pared to actual flight. Therefore, for the case reported here, one could 
question the fidelity of the essential sinfc-rate or direction-of-f light 
cues as well as distance along the runway. At the same time it is not 
clear, without further experimentation, what the specific origins of these 
difficulties were in engineering terms used to specify simulator 
components. 


OOHGLUDING REMARKS 


The airline landing data analyzed yielded a rich variety of results 
with implications in several areas including quantification of piloting 
technique and the fidelity of an airline training simulator for the land* 
Ing maneuver. Besides providing important quantif ic:?tlon in these various 
areas, the data have also provided the basis for a revised analytical 
model of the flare maneuver. In fact the model developed provides a uSe • 
ful bridge between the raw data collected and the ensuing interpretations 
of those data. 

Several metrics have evolved with regard to describing the landing 
maneuver. The first metric is the phase plane representation to charac* 
terize the flare maneuver, not only in terms of the ultimate landing per* 
formance but also how that performance was achieved: whether it was the 
result of a last-minute abrupt pull-up leaving no room for error or mis- 
judgment, or whether it was the result of an exceedingly gentle decay in 
sink rate which might be accompanied by a large loss of airspeed prior to 
touchdown. The phase plane also, of course, shows where there were dan- 
gerously high sink rates at low altitudes or if there was a floating or 
ballooning tendency. 

Two metrics which bear a direct dependence upon the effective closed- 
loop parameters are the Inferred pilot-vehicle loop gains, namely the 
height gain and the direct ion-of-f light gain. The height gain was shown 
to be dependent upon the closed-loop natural frequency and the true air- 
speed. Thfc direction-of-f light gain was shown to be a function of the 
product of damping ratio and natural frequency along with the basic ver- 
tical response lag for the aircraft. 

An Important aspect of the analysis performed here is the quantifica- 
tion of the landing maneuver as it is performed on the actual aircraft. 
This provides an important, baseline for examining simulator fidelity. 
Without this description of piloting technique, we would have to rely far 
more heavily upon terminal landing performance (l.e., scoring of the 
touchdown sink rate or distance along the runway) or on strictly subjec- 
tive judgments. 
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There are indications in the closed-loop pilot-vehicle response 
parameters that the fidelity of the training simulator used in this study 
was deficient in at least one modality* The outside visual scene is most 
suspect; but the simulator motion system cannot be ruled out without fur- 
ther Investigation nor, for that matter, can the simulator model 
Implementation. 
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